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TITLE : METHOD AND APPARATUS FOR GENERATING A SET OF 
FILTER COEFFICIENTS PROVIDING ADAPTIVE NOISE 
REDUCTION 

5 Cross-references to Related Application 

This application is related to the following 
applications : 

10 1* United States Patent Application entitled, "Method and 
Apparatus for Generating a Set of Filter Coefficients 
for a Time Updated Adaptive Filter", filed on the same 
date as the instant application by Awad T. et al . 

15 2. United States Patent Application entitled, "Method and 
Apparatus for Providing an Error Characterization 
Estimate of an Impulse Response Derived using Least 
Squares" , filed on the same date as the instant 
application by Awad T. et al . 

20 

3. United States Patent Application entitled, "Method and 
Apparatus for Generating a Set of Filter Coefficients", 
filed on the same date as the instant application by 
Awad T. et al. 

25 

The contents of the above noted documents are hereby 
incorporated by reference. 

30 Field of the Invention 

The present invention relates generally to time 
updated adaptive systems and, more particularly, to a 
35 method and apparatus for generating time updated filter 
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coefficients providing adaptive noise reduction. The 
method and apparatus are suitable for use in a time updated 
adaptive filter as can be used in echo cancellation 
devices, equalizers and, in general, systems requiring time 
5 updated adaptive filtering. 

Background 

10 Various adaptive filter structures have been developed 

for use in time updated adaptive systems to solve 
acoustical echo cancellation, channel equalization and 
other problems; examples of such structures include, for 
example, transversal, multistage lattice, systolic array, 

15 and recursive implementations. Among these, transversal 
finite-impulse-response (FIR) filters are often used, due 
to stability considerations, and to their versatility and 
ease of implementation. Many algorithms have also been 
developed to adapt these filters, including the least-mean - 

20 squares (LMS) , recursive least-squares, sequential 
regression, and least-squares lattice algorithms. 

The method of least squares is sometimes used to 
derive a set of filter coefficients in an adaptive filter. 

25 A deficiency of the least squares method is that it 
sometimes produces a set of filter coefficients whose 
performance, when used by a filter, is dependent upon the 
spectral properties of the signal being processed. This 
may result in an adaptive system where the set of filter 

30 coefficients will have a satisfactory performance in a 
first range of frequencies, and a very unsatisfactory 
performance in a second range of frequencies. 
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Consequently, there is a need in the industry for 
providing a filter adaptation unit suitable for producing a 
set of filter coefficients that alleviates at least in part 
the deficiencies of the prior art. 

5 

Summary of the Invention 

In accordance with a broad aspect, the invention 

10 provides a method suitable for producing a set of filter 
coefficients. A sequence of samples of a first signal and a 
sequence of samples of a second signal are received, where 
the second signal includes a certain component that is 
correlated to the first signal. A first set of filter 

15 coefficients is generated at least in part on the basis of 
the first signal and the second signal. The first set of 
filter coefficients is such that when a filter applies the 
first set of filter coefficients on the first signal, a 
first estimate of the certain component in the second 

20 signal is generated. A set of performance data elements is 
generated to evaluate the performance of a filter using the 
first set of coefficients on the first signal. The 
performance is evaluated on a per frequency band basis and 
each performance data element is associated to a respective 

25 frequency band selected from a set of frequency bands. A 
set of correction signals is generated including a 
correction signal for each frequency band where the 
associated performance data element is indicative of an 
unsatisfactory performance. Following this, a second set 

30 of filter coefficients is generated at least in part on the 
basis of the first signal, the second signals and the set 
of correction signals. The second set of filter 

coefficients is such that when a filter applies the second 
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set of filter coefficients on the first signal, a second 
estimate of the certain component in the second signal is 
generated. A signal indicative of the second set of filter 
coefficients is released in a format suitable for use by a 
5 filter. 

The present inventors have made the unexpected 
discovery that by adding energy in a given frequency band 
and generating a second set of filter coefficients, a 
10 reduction in the amplitude of the frequency response 
behavior for the given frequency band could be achieved. 
The energy in a given frequency band is added by generating 
a correction signal. 

15 In a specific implementation, the set of frequency 

bands comprises one or more frequency bands. 

In a specific implementation, each correction signal 
in the set of correction signals is indicative of a signal 

20 having signal energy substantially within the frequency 
band for which it was generated. For example, if the 
frequency band 1000Hz ± 8Hz is associated performance data 
element indicative of an unsatisfactory to a performance, a 
correction signal having signal energy substantially within 

25 the frequency band 1000Hz ± 8Hz is generated. 

In a non- limiting implementation, the performance data 
elements are indicative of error signal amplitude estimates 
for respective frequency bands selected from the set of 
30 frequency bands. A performance data element is indicative 
of an unsatisfactory performance if it is indicative of an 
error amplitude estimate that exceeds a certain threshold. 
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Another advantage of this method is that the error 
performance data elements provide an indication of the 
performance of the set of filter coefficients on a per 
5 frequency basis. This performance indication may be used 
for improving the performance of the filter coefficients 
for selected frequency bands in which the performance is 
unsatisfactory. 

10 In a specific implementation, the method includes 

generating a first set of contextual information data 
elements at least in part on the basis of the first and 
second signals. The first set of filter coefficient is 
generated on the basis of the first set of contextual 

15 information data elements. The first set of contextual 
information data elements is then processed on the basis of 
the set of correction signals to generate a modified set of 
contextual information data elements. The modified set of 
contextual information data elements is then processed to 

20 generate the second set of filter coefficients. 

In a non-limiting example, the first set of contextual 
information data elements includes a set of auto- 
correlation data elements for the sequence of samples of 

25 the first signal and a set of cross-correlation data 
elements for the sequence of samples of the first signal 
and the sequence of samples of the second signal. The set 
of auto-correlation data elements forms a two-dimensional 
auto-correlation matrix data structure "Ai" including a 

30 plurality of entries and the cross-correlation data 
elements form a vector U B" . The relationship between the 
two-dimensional auto-correlation matrix data structure A x 
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and the cross-correlation data elements form a vector B can 
be expressed as a set of linear equations: 

Equation 1 

5 A X -\^B 

where hi is a vector including the first set of filter 
coefficients. The entries of the two-dimensional matrix 
data structure A x are modified on the basis of the set of 
correction signals to generate a modified two-dimensional 
10 matrix data structure A 2 . The relationship between the 
modified two-dimensional auto-correlation matrix data 
structure A 2 and the cross-correlation data elements form a 
vector B that can be expressed as a set of linear 
equations : 

15 

Equation 2 

A 2 -h 2 = B 

where h 2 is a vector including the second set of filter 
coefficients. A Cholesky decomposition method is applied 

20 to the modified auto-correlation matrix data structure A 2 to 
derive a lower triangular matrix data structure and an 
upper triangular matrix data structure. The lower 

triangular matrix data structure and the upper triangular 
matrix data structure are processed on the basis of the set 

25 of cross -correlation data elements to derive the second set 
of filter coefficients h 2 . 

In accordance with another broad aspect, the invention 
provides an apparatus for implementing the above-described 
30 method. 
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In accordance with, yet another broad aspect, the 
invention provides a computer readable medium including a 
program element suitable for execution by a computing 
apparatus for producing a set of filter coefficients in 
5 accordance with the above described method. 

In accordance with another broad aspect, the invention 
provides an adaptive filter including a first input, a 
second input, a filter adaptation unit and a filter. The 

10 first input is for receiving a sequence of samples from a 
first signal and the second input is for receiving a 
sequence of samples of a second signal. The second signal 
includes a component that is correlated to the first 
signal. The filter adaptation unit receives the samples of 

15 the first signal and the second signal from the first and 
second inputs respectively. The filter adaptation unit 
includes a coefficient generation unit, a performance 
evaluation unit, a noise reduction unit and an output. The 
coefficient generation unit generates a first set of filter 

20 coefficients at least in part on the basis of the first and 
second signals. The first set of filter coefficients is 
such that when a filter applies the first set of filter 
coefficients on the first signal, a first estimate of the 
certain component in the second signal is generated. The 

25 performance evaluation unit generates a set of performance 
data elements for a filter using the first set of 
coefficients. Each performance data element is associated 
to a respective frequency band selected from a set of 
frequency bands. The noise reduction unit determines for 

30 each frequency band in the set of frequency bands if the 
associated performance data element is indicative of a 
satisfactory performance or an unsatisfactory performance. 
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The noise reduction unit generates a set of correction 
signals including a correction signal for each frequency 
band where the associated performance data element is 
indicative of an unsatisfactory performance. The noise 
5 reduction unit then generates a second set of filter 
coefficients on the basis of the first signal, the second 
signals and the set of correction signals. The second set 
of filter coefficients is such that when a filter applies 
the second set of filter coefficients on the first signal, 

10 a second estimate of the certain component in the second 
signal is generated. A signal indicative of the second set 
of filter coefficients is released at the output in a 
format suitable for use by a filter. The filter receives 
the first signal from the first input and the second set of 

15 filter coefficients from the filter adaptation unit. The 
filter applies a filtering operation to the first signal on 
the basis of the second set of filter coefficients to 
generate an estimate of the component in the second signal, 
the component being correlated to the first signal. 

20 

In accordance with another aspect, the invention 
provides an echo cancellor comprising the above described 
adaptive filter. 

25 In accordance with yet another aspect, the invention 

provides a filter adaptation unit suitable for producing a 
set of filter coefficients. The filter adaptation unit 
includes means for receiving a sequence of samples of a 
first signal and means for receiving a sequence of samples 

30 of a second signal. The second signal includes a certain 
component that is correlated to the first signal. The 
filter adaptation unit also includes means for generating a 
first set of filter coefficients at least in part on the 
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basis of the first and second signals. The first set of 
filter coefficients is such that when a filter applies the 
first set of filter coefficients on the first signal, a 
first estimate of the certain component in the second 
5 signal is generated. The filter adaptation unit also 
includes means for generating a set of performance data 
elements for a filter using the first set of coefficients, 
each performance data element being associated to a 
respective frequency band selected from a set of frequency 

10 bands. The filter adaptation unit also includes means for 
determining for each frequency band in the set of frequency 
bands if the associated performance data element is 
indicative of a satisfactory performance or an 
unsatisfactory performance. The filter adaptation unit also 

15 includes means for generating a set of correction signals 
including a correction signal for each frequency band where 
the associated performance data element is indicative of an 
unsatisfactory performance. The filter adaptation unit 
also includes means for generating a second set of filter 

20 coefficients at least in part on the basis of the first 
signal, the second signals and the set of correction 
signals. The second set of filter coefficients is such 
that when a filter applies the second set of filter 
coefficients on the first signal, a second estimate of the 

25 certain component in the second signal is generated. The 
filter adaptation unit also includes means for releasing a 
signal indicative of the second set of filter coefficients 
in a format suitable for use by a filter. 

30 Other aspects and features of the present invention 

will become apparent to those ordinarily skilled in the art 
upon review of the following description of specific 
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embodiments of the invention in conjunction with the 
accompanying figures. 

Brief Description of the Drawings 

5 

Fig. 1 is a block diagram of a time adaptive system 
including a filter adaptation unit in accordance with an 
embodiment of the present invention; 

10 

Fig. 2 is a block diagram of the filter adaptation unit of 
figure 1 in accordance with a specific example of 
implementation of the invention; 

15 Fig. 3 is a functional block diagram of a coefficient 
generation unit suitable for use in the filter adaptation 
unit of figure 2 in accordance with a non-limiting example 
of implementation of the invention; 

20 Fig. 4 is a functional block diagram of a context update 
module suitable for use in the coefficient generation unit 
of figure 3 in accordance with a non-limiting example of 
implementation of the invention; 

25 Fig. 5 is a functional block diagram of a filter 
coefficient computation unit suitable for use in the 
coefficient generation unit of figure 3 in accordance with 
a non-limiting example of implementation of the invention; 

30 Fig. 6 is a block diagram of a data structure including a 
set of cross-correlation data elements in accordance with a 
non-limiting example of implementation of the invention; 
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Fig. 7 shows an auto-correlation matrix data structure in 
accordance with a non- limiting example of implementation of 
the invention; 

5 Fig. 8 is a functional block diagram of a performance 
evaluation unit suitable for use in the filter adaptation 
unit of figure 2 in accordance with a non-limiting example 
of implementation of the invention; 

10 Fig. 9 is a functional block diagram of a standard 
deviation computation unit suitable for use in the 
performance evaluation unit of figure 8 in accordance with 
a non-limiting example of implementation; 

15 Fig. 10 is a flow diagram showing a process for generating 
a set of performance data elements in accordance with a 
specific example of implementation of the invention; 

Fig. 11 is a functional block diagram of a noise reduction 
20 unit suitable for use in the filter adaptation unit of 
figure 2 in accordance with a non- limiting example of 
implementation of the invention; 

Fig. 12 is a flow diagram showing a process implemented by 
25 the noise reduction unit for generating a new set of filter 
coefficients in accordance with a specific example of 
implementation of the invention; and 

Fig. 13 is a block diagram of an apparatus for generating a 
30 set of filter coefficients in accordance with a specific 
example of implementation of the invention. 
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Detailed Description 

Figure 1 shows a time adaptive system 170 in 
5 accordance with, an embodiment of the present invention. In 
one example of a non-limiting implementation, the time 
adaptive system 170 is used to remove unwanted components 
of a return signal Z 102 from a forward signal Y 106. 
Typically, the return signal Z 102 passes through a system 

10 150 and emerges in the form of a noise signal E 114 which 
corrupts the forward signal Y 106, resulting in a corrupted 
forward signal X 104. In a digital system, this corruption 
process may be modelled as a sample -by- sample addition 
performed by a conceptual adder 118. Thus, each sample of 

15 the corrupted forward signal X 104 is the sum of a 
component due to the (clean) forward signal Y 106 and 
another component due to the noise signal E 114 where the 
noise signal E 114 is correlated to the return signal Z 
102 . 

20 

A non-limiting use of the time adaptive system 170 is 
in the context of acoustical echo cancellation, for 
example, in a hands -free telephony system that includes a 
loudspeaker and a microphone. In this case, the forward 

25 signal Y 106 is a locally produced speech signal which is 
injected into the microphone (represented by conceptual 
adder 118) , the return signal Z 102 is a remotely produced 
speech signal which is output by the loudspeaker, the 
system 150 is a room or car interior and the noise signal E 

30 114 is a reverberated version of the return signal Z 102 
which enters the same microphone used to pick up the 
forward signal Y 106. The corrupted forward signal X 104 
is the sum of the signals input to the microphone, 
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including the clean forward signal Y 106 as well as the 
reverberation represented by the noise signal E 114. 

Another non-limiting use of the time adaptive system 
5 170 is in the context of electric echo cancellation, for 
example, where the echo is caused by an analog/digital 
conversion on the transmission channel rather than by a 
signal reverberation in a closed space. In this case, the 
forward signal Y 106 is a locally produced speech signal 

10 which travels on the forward path of the communication 
channel, the return signal Z 102 is a remotely produced 
speech signal which travels on the return path of the 
communication channel, the system 150 is an analog/digital 
conversion unit and the noise signal E 114 is a reflected 

15 version of the return signal Z 102 which travels on the 
same forward path of the communication channel as the 
forward signal Y 106. The corrupted forward signal X 104 
is the sum of the clean forward signal Y 106 as well as the 
noise signal E 114. 

20 

To cancel the corruptive effect of the noise signal E 
114 on the forward signal Y 106, there is provided a filter 
110, suitably embodied as an adaptive digital filter. The 
filter 110 taps the return signal Z 102 (which feeds the 
25 system 150) and applies a filtering operation thereto. In 
one embodiment of the present invention, such a filtering 
operation can be performed by a finite impulse response 
(FIR) filter that produces a filtered signal F 112. 

30 The filter 110 includes a plurality N of taps at which 

delayed versions of the return signal Z 102 are multiplied 
by respective filter coefficients, whose values are denoted 
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hj, 0 ^ j £ W-l. The 2\T products are added together to 
produce the filter output at time T. Simply stated, 
therefore, the filtered signal F 112 at a given instant in 
time is a weighted sum of the samples of the return signal 
5 Z 102 at various past instances. 

The filter coefficients hj are computed by a filter 
adaptation unit 100 configured to receive the return signal 
Z 102 and the corrupted forward signal X 104. The manner 
10 in which the filter adaptation unit 10 0 processes these 
signals to compute the filter coefficients hj is described 
in greater detail herein below. 

Mathematically, the filtered signal F 112 at the 
15 output of the filter 110 can be described by the following 
relationship : 

Equation 3 

N-l 

20 

where 

t is the current sample time; 

f t is the value of the filtered signal F 112 at time t; 
25 hj is the value of the j th filter coefficient ; 

z k is a sample of the return signal Z 102 at time k; 
and 

N is the length (i.e., the number of taps) of the 
filter 110. 



30 
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For convenience 7 equation 1 may be represented in matrix 
form as follows: 

Equation 4 

5 /, =h T z t 

where the underscore indicates a vector or matrix, where 
the superscript " T " denotes the transpose (not to be 
confused with the sample time w t" used as a subscript) and 
10 where: 

Equation 5 







z t 




and z, - 








„ z HW-i)_ 



15 The output of the filter 110, namely the filtered signal F 
112, is subtracted on a sample-by-sample basis from the 
corrupted forward signal X 104 to yield an estimate, 
denoted Y* 108, of the clean forward signal Y 106. In a 
desirable situation, the filter coefficients hj will be 

20 selected so as to cause the resultant signal Y* 108 to be 
"closer" to the clean forward signal Y 106 than corrupted 
forward signal X 104. For at least one optimal combination 
of filter coefficients, the resultant signal Y* 108 will be 
at its "closest" to the clean forward signal Y 106. 

25 

It is sometimes convenient to define ^closeness" in 
terms of a least-squares problem. In particular, the 
optimal filter coefficients are obtained by solving an 



86147-5 



16 



optimisation problem whose object it is to minimise, from 
among all possible combinations of filter coefficients h jf 
the mean square difference between instantaneous values of 
the resultant signal Y* 108 and the clean forward signal Y 
5 106. The actual value of the minimum mean-square error is 
typically not as important as the value of the optimal 
filter coefficients that allow such minimum to be reached. 

A reasonable assumption is that noise signal E 114 
10 adds energy to forward signal Y 106. Therefore an 
expression of the least square problem is to minimise the 
resultant signal Y* 108. Mathematically, the problem in 
question can be defined as follows: 

15 Equation 6 

h 

where E[°\ denotes the expectation of the quantity u o" over 
a subset of time up until the current sample time t. For 
20 the purpose of this specific example, the expression E[o] t , 
will denote the summation of the quantity w o" over a subset 
of time up until the current sample time t. Another 
commonly used notation is ^[o\ . Therefore, for the purpose 

of this example the expressions E[°) t and ^[°\ are used 
25 interchangeably. 

Now, from Figure 1 it is noted that: 
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Equation 7 

yl=x k -f k =x k -h T k z k 



and 

5 Equation 8 



Therefore, the problem stated in Equation 4 becomes: 



10 Equation 9 

minE[(x k -h T z k ) 2 l, 

h 



Expanding the term in square brackets, one obtains: 

15 

Equation 10 

(x k -h T z k ) 2 =x 2 k -2x k h T z k +(h T z k )\ 

Taking the expected value of both side of equation 8, one 
20 obtains : 

Equation 11 

E[{x k -h T z k f] t =E[xl\ -2E[x k h T z k ] t ^E\h T z k z T k hl 

25 Minimizing the above quantity leads to a solution for which 
the resultant signal Y* 108 will be at its minimum and 
likely at its "closest" to the clean forward signal Y 106. 
To minimize this quantity, one takes the derivative of the 
right-hand side of Equation 9 with respect to the filter 
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coefficient vector h and sets the result to zero, which 
yields the following: 

Equation 12 

4rW*ll -E[2x k h T z k l +E[h T z k z T k hl) = -2E[x k z k ] t + 2E[z k z T k h] t = 0. 
ah 

5 Thus, an "optimal" set of filter coefficients hi solves the 
set of equations defined by: 

Equation 13 

E[z h z T k \h x =E[x k z h ] t . 

10 

It is noted that equation 11 expresses the filter 
coefficient optimisation problem in the form A x h = B, where 

A l =E[z k z T k ] t and B = E[x k z k \ and that the matrix Aj is symmetric 
and positive definite for a non-trivial signal Z 102. The 
15 usefulness of these facts will become apparent to a person 
of ordinary skill in the art upon consideration of later 
portions of this specification. 

It is noted that since the properties of the signals Z 
20 102 and X 104 change with time, so too does the optimal 
combination of filter coefficients hjtj], Q< j < N-l, which 
solves the above problem in Equation 11. 

Noting that signal X = signal Y + signal E, the above 
25 equation 11 can be rewritten as follows: 

Equation 14 

E\z k z k \h x =£[(^+e J )2j / . 
E\z k z k \h x =E[e k z k ] t . + E[y k z k l 
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In other words, we can separate the filter function 
defined by the set of filter coefficients hifjj, 0^ j ^ N-l 
into two components. The first term on the right hand side 

of the equation E[e k z k \ contributes to the desired filter 
5 behaviour since the filter 110 tries to obtain a filter 
such that signal F 112 equals signals E 114. Therefore, 
the second term on the right hand side of the equation 

E[y k z k ] t contributes to the error behaviour of the filter 110. 
Therefore the error function can be expressed as follows: 

10 

Equation 15 

E [Zkzll error _ function = E[y k z k ] r 

It will be readily observed that where signal Z 102 
15 and signals Y 106 are perfectly uncorrelated, i.e. E[y k z k ] t =0 
for all t, the error function is zero. 

In certain cases, it has been observed that the set of 
filter coefficients fti/jj, 0^ j ^ N-l, have a different 

20 performance depending on the frequency components of signal 
Z 102. For example, take signal Z 102 having energy mainly 
in the 0 to 2 kHz frequency range and only low energy in 
the 2 to 4 kHz range, and signal X 104 having the opposite 
behavior namely low energy in the 0 to 2 kHz range and 

25 energy mainly in the 2 to 4 kHz frequency range. It has 
been observed that the energy of the error function 
resulting from the use of the filter coefficients hi[j], 0^ 
j ^ N-l, will be low in the 0 to 2 kHz frequency range, and 
high in the 2 to 4 kHz frequency range. A result of the 

30 above is that if signal Z 102 includes at some instance of 
time components having energy in the 2 to 4 kHz range, the 
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use of the filter coefficients may have some undesirable 
effects due to the energy of the error signals in that 
range such as for example to amplify signal Z 102 in those 
frequency bands. The inventors have made the unexpected 
5 discovery that by using the error function of the filter, 
it is possible to provide an new set of filter coefficients 
which may reduce some undesirable effects described above. 

The manner in which the characteristics of the error 
10 function are generated and the manner in which they may be 
used will now be described in greater detail with reference 
to Figure 2, which depicts the filter adaptation unit 100 
in greater detail. 

15 Filter Adaptation Unit 100 

The filter adaptation unit 10 0 includes a first input 
252 for receiving a sequence of samples of a first signal Z 
102, a second input 254 for receiving a sequence of samples 
20 of a second signal X 104, a coefficient generation unit 
200, a performance evaluation unit 202, a noise reduction 
unit 210 and an output 256 for releasing an output signal 
indicative of a set of filter coefficients H 116. 

25 Coefficient Generation Unit 200 

The coefficient generation unit 200 receives the first 
signal Z 102 and the second signal X 104 from the first 
input 252 and the second input 2 54 respectively. The 
30 coefficient generation unit 200 is operative to generate a 
set of filter coefficients Hnew 206 at least in part on the 
basis of the first signal Z 102 and the second signal X 
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104. In a specific example, the coefficient generation 
unit 200 applies a least squares method on the first signal 
102 and second signal 104 to derive a first set of filter 
coefficients Hnew 206. The coefficient generation unit 200 
5 generates a set of coefficients h x [j] , 0< j < N-l by solving 
equation 13 reproduced below: 



Equation 13 



10 E\ik£k\hi = 



The coefficient generation unit 200 releases a first set of 
coefficients h lr designated as Hnew 2 06 in figure 2. 

15 Figure 3 shows a specific non- limiting implementation 

of the coefficient generation unit 200. As shown, the 
coefficient generation unit 200 includes a context update 
module 300 and a filter coefficient computation unit 302. 

20 The context update module 3 00 receives the sequence of 

samples of the first signal Z 102 and the sequence of 
samples of the second signal X 104. The context update 
module 3 00 generates and maintains contextual information 
for the first signal Z 102 and the second signal X 104. 

25 The context update module 300 maintains sufficient 
contextual information about signals Z 102 and X 104 to be 

able to derive E[z k z T k ] t and E[x k z k \ for the current time t. 

This contextual information is then used by the filter 
coefficient computation unit 3 02 to generate the set of 
30 filter coefficients Hnew 206. The specific realization of 
the context update module 3 00 may vary from one 
implementation to the other without detracting from the 
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spirit of the invention. For the purpose of this 
description r the contextual information comprises a first 
set of data elements and a second set of data elements , 
where the first set of data elements is indicative of the 

5 auto-correlation of signal Z 102 E\z k z k \ . The second set of 
data elements is a set of cross-correlation data elements 
E\x k z_ k \ of the first signal Z 102 with the second signal X 
104. 

10 Figure 4 depicts the context update module 300 in 

greater detail. The context update module 300 includes an 
auto-correlation computing unit 400 and a cross-correlation 
computing unit 404. 

15 The auto- correlation computing unit 400 generates a 

first set of data elements indicative of an auto- 
correlation data structure for the sequence of samples of 

the first signal Z 102 and is indicative of E[z k z T k ] t since 
time 0. In a specific example, the first set of data 
20 elements can be represented by an NxN auto-correlation 
matrix Ai 700 of the type shown in figure 7 including N 2 
entries. The NxN auto-correlation matrix Ai 700 is 
symmetric meaning that : 

25 Ax = A X T 

Matrix Ai 700 is also positive definite meaning that 
the inverse of matrix A x exists. Since matrix A x is an 
auto-correlation matrix, it will be positive definite when 
30 signal Z 102 is non-trivial. The NxN data elements of the 
auto-correlation matrix Ai 700 are stored in a data 
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structure in an auto-correlation memory unit 402. For each 
received sample of signal Z 102, the contents of the auto- 
correlation memory unit 4 02 are updated. The generation of 
an auto-correlation matrix is well-known in the art to 
5 which this invention pertains and as such will not be 
described further here. There are many ways in which the 
auto -correlation matrix Ai may be generated and the 
invention is not limited to the manner in which the auto- 
correlation matrix is obtained. A specific manner in which 

10 the auto-correlation matrix may be updated and generated is 
described in co-pending patent application entitled "METHOD 
AND APPARATUS FOR GENERATING A SET OF FILTER COEFFICIENTS 
FOR A TIME UPDATED ADAPTIVE FILTER" filed on same date as 
the present invention by Thomas J. Awad et al . whose 

15 contents are hereby incorporated by reference. 

The cross -correlation computing unit 404 computes a 
second set of data elements including a set of cross- 
correlation data elements between the signals Z 102 and X 

20 104 indicative of E[x k z k ] t . For each received sample of the 
first signal Z 102 and the second signal X 104, the cross- 
correlation computing unit 4 04 computes the following for t 
> M: 

Equation 16 

t-\ 

25 E[x k z k ] tJ =Y, z i+J-M+\ x i for j= 0 ... M-l 

Where x t . ± is a new sample of the signal X 104 at time 
T, z t -i is a new sample of Z 102 at time t and M is the 
window size for the cross -correlation computation. In the 

30 mathematical expression shown in the above equation, E[x k z k \ 
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denotes a computation of the expected value of the cross - 
correlation between the first signal Z 102 and the second 
signal X 104 since time 0 (no sample) until the current 

sample at time t. E[x k z k \ is a set of M cross-correlation 
5 data elements. The M cross-correlation data elements are 
stored in a data structure in a cross-correlation memory- 
unit 406. Figure 6 shows the cross-correlation memory unit 
406 storing a data structure in the form of a vector of M 
elements including the M cross-correlation data elements. 

10 For the purpose of simplicity, we will refer to the set of 
M cross-correlation data elements in memory unit 406 as 
vector XZ. For each received sample of signal X 104 and 
each received sample of signal Z 102, the content of vector 
XZ in the cross-correlation memory unit 406 is updated as 

15 follows: 

Equation 17 

XZ\j\=XZ\i\_ x +z t _^x t _ x for j= 0 ... M-l 

20 where t > M. 

In a non-limiting embodiment, the context update 
module 3 00 includes buffer modules for accumulating samples 
of signal Z 102 and signal X 104. In this alternative, a 
25 plurality of samples of signal Z 102 and a plurality of 
samples of signal X 104 are accumulated in the buffers and 
the above described computations are effected for each 
sample of signal Z 102 and signal X 104 in the buffers. 

30 Alternatively, when the context update module 300 

includes buffer modules, the auto-correlation matrix A x and 
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the cross-correlation data elements in vector XZ may be 
computed in the frequency domain using FFT (Fast Fourier 
transform) techniques. The set of auto-correlation and 
cross-correlation data elements resulting from this 
5 computation are in the frequency or spectral domain. To 
obtain the temporal values of the set of auto-correlation 
and cross-correlation data elements, an Inverse Fourier 
Transform (IFF) must be applied to the spectral values. 
The process of computing an auto-correlation and a cross - 
10 correlation in the spectral domain between signal Z 102 and 
signal X 104 is well-known to the person skilled in the art 
and therefore will not be described further here. 

The filter coefficient computation unit 302 makes use 
15 of the contextual information provided by the context 
update module 300 to generate a set of filter coefficients 
Hnew 206. The frequency of the computation of the new set 
of filter coefficients Hnew 206 may vary from one 
implementation to the other without detracting from the 
20 spirit of the invention. In a non-limiting example, a new 
set of filter coefficients Hnew 206 is computed every L 
samples of signals Z 102 7 where L is >= 2. 

Figure 5 shows the filter coefficient computation unit 
25 302 in greater detail in accordance with a non-limiting 
implementation. The filter coefficient computation unit 
3 02 includes a matrix memory unit 500 for storing the NxN 
matrix Ai, cross correlation memory unit 501 for storing 
cross-correlation vector XZ and a linear solver unit 560. 
30 Although the matrix memory unit 500 of the filter 
coefficient computation unit 302 and the auto-correlation 
memory unit 4 02 of the context update module 3 00 are shown 
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as separate components, it will be readily appreciated that 
they may be embodied in a same physical device and may 
share functional components without detracting from the 
spirit of the invention, 

5 

The linear solver unit 560 processes the NxN auto- 
correlation matrix Ai in matrix memory unit 500 in 
combination with cross-correlation vector XZ from the 
cross-correlation memory unit 501 to solve the following 
10 linear system for a set of filter coefficients in vector h x i 

Equation 18 

A^h^XZ 

15 where Ai is an NxN positive definite symmetric matrix, 

hi is an lxN vector and XZ is an lxM vector. If M = N, a 
single vector hi can be computed from the above equation. 
If M > N, then a vector h 2 of dimension lxN can be computed 
for subsets of N elements of vector n XZ" . For the purpose 

20 of simplicity, we will describe the case where N=M, and 
where one set of filter coefficients is generated by the 
filter coefficient computation unit 302 by solving equation 
18. There are many known methods that can be used to solve 
linear systems and consequently all these will not be 

25 described further herein. Typically, the inverse of matrix 
Ai, namely Ai" 1 , needs to be computed in order to obtain h x : 

Equation 19 

h= a; 1 • XZ 

where 

A r A- l =I 

30 where I is an NxN identity matrix. 
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Typically, computing the inverse of an NxN matrix is 
complex and requires significant computing resources 
especially when N is large. Several other well known 
5 methods have been developed to reduce the complexity of 
this computation. Examples of such methods include QR 
substitution, Cholesky decomposition, LU decomposition, 
Gauss- Jordan elimination, amongst others. Any suitable 
method for solving a set of linear equations may be used by 

10 the linear solver unit 560 to derive the vector h x including 
the set of filter coefficients. For more information 
regarding methods for solving sets of linear equations, the 
reader is invited to refer to "Numerical Recipes in C: The 
Art of Scientific Computing", William H. Press et al . , 

15 Cambridge University Press (Chapter 2) . The contents of 
this document are hereby incorporated by reference. 

In a specific non-limiting example of implementation, 
the linear solver unit 560 makes use of the symmetric and 
20 positive definite characteristic of matrix A x by using 
Cholesky decomposition to solve the set of linear equations 
described by equation 18. Conceptually, the specific non- 
limiting example of implementation the linear solver unit 
560 solves for the following: 

25 Equation 20 

A x h x =XZ 

As shown in figure 5, the linear solver unit 560 
includes a Cholesky decomposition unit 502, a triangular 
30 matrix inverter 5 04, a triangular matrix transpose inverter 
505 and a matrix multiplier and solver 506. The Cholesky 



86147-5 



28 



decomposition unit 502 processes matrix A x to generate a 
lower triangular matrix W such that : 

Equation 21 

A = W -W Tmnspose 

5 

Following this, the triangular matrix inverter 504 and 
the triangular matrix transpose inverter 505 process the 
lower triangular matrix W and its transpose respectively to 
generate the inverse of matrix W, namely W 1 , and the 

10 inverse of the transpose, namely w Transpose " 1 . Although the 
linear solver unit 560 depicted in figure 5 includes a 
triangular matrix inverter 504 and triangular matrix 
transpose inverter 505, these may be implemented by the 
same physical module without detracting from the spirit of 

15 the invention. In general, the inverse of lower triangular 
matrix W requires fewer computations to compute than that 
of matrix Ai. 



The matrix multiplier and solver unit 506 then solves 
20 the set of linear equations by substitution to obtain the 
set of filter coefficients in vector ft 2 . The matrix 
multiplier and solver 506 receives W 1 and solves for a 
vector y: 

Equation 22 

solving for y 
y = W~ x XZ 

The matrix multiplier and solver 506 also receives w™ 1181 * 08 *" 1 
and uses solution to equation 22 to solve for h x as follows: 

Equation 23 

solving for h 
h } =W Tmnspos *- x y 
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Vector h x is then released at the output forming a 
signal including a set of N filter coefficients Hnew 206. 
It is to be appreciated that other methods and 
5 implementations for solving a set of linear equations using 
Cholesky decomposition are possible without detracting from 
the spirit of the invention. For example, although the 
implementation depicted in figure 5 makes use of triangular 
matrix inverter/ triangular matrix transpose inverter units 
10 504, 505, direct solving of the following linear equations: 

Equation 24 

Wy = XZ 

15 and 

Equation 25 

W Tranpose \=y 

20 can be done as well to derive vector hi. 

The generated set of filter coefficients Hnew 206 is 
then released at the output 356 of the coefficient 
generation unit 200. 

25 

Performance Evaluation Unit 202 

In accordance with a specific implementation, the 
performance evaluation unit 2 02 characterizes the error 
30 function associated with adaptive filter 170 on the basis 
of the knowledge of the amplitude of the first signal Z 102 
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and of an estimate of the amplitude of the forward signal Y 
106. 

Theoretical Explanation 

5 

As was described previously, the error function can be 
expressed by equation 15 reproduced below: 



Equation 15 

1 0 E[z k / k \ error function = E[y k z k \ . 



In order to characterize the error function of the 
adaptive filter 170, a single tap filter is considered. In 
a single point tap system where E[ZiZi T ]t has a single data 
15 element and E [viz-lI t has a single data element, equation 15 
can be written as follows: 



Equation 26 

t-i t-\ 



^z l z l error _ function = ^z.y r 



i=0 t 

20 

Solving for the error function at time t we obtain: 

Equation 27 

error _function{t) = -pj 

where 

25 t is the current sample time; 

Zk is a sample of the return signal Z 102 at time k-, 
and 
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y k is a sample of the return signal Y 106 at time k; 

For the purpose of deriving a mathematical model to 
characterize the error function, an assumption is made that 
5 signal Z 102 and signal Y 106 are substantially independent 
of one another and are white. For the purpose of this 
specification, a signal S is white if E(SiSj)~ 0 for i^j and 
signals S and Q are independent if E(SiQj)~0 for all i,j. 
The above assumptions allow considering that the error 
10 added by each sample pair is an independent variable which 
can be described by the following expression: 

Equation 28 

z kyk 

error k = 

z k z k 

15 where z k and y k are the kth samples of signals Z 102 and Y 
106 respectively and error k is the kth component of the 
error function due to the kth samples of signals Z 102 and 

Y 106. The error function can be considered as the sum of 
the errors added by the samples. In statistics , the above 

20 described error function can be considered to be a random 
variable. In order to characterize this random variable, 
the mean and the variance (or alternatively the standard 
deviation) can be computed. Since signal Z 102 and signal 

Y 106 are assumed to be independent, the mean of this 
25 random variable is 0 and it will be shown below that the 

standard deviation can be given by: 
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Equation 29 



<y, =- 



V/=o 



( t-i \ 



2>, -KW 



t-i 



i=0 



Deriving the Standard Deviation Equation 

The error inserted at each pair of samples {z± r y±}can be 
represented mathematically by the following: 



10 Equation 30 



error = ■ 



If the error components inserted at each pair of samples 

are equal to one another an are assigned equal weight, 

15 standard deviation of the error function after t samples 
can be expressed by the following expression: 

Equation 31 

error 

o t = — y~ where t is the number of samples 
and error is the error per sample 



20 When each sample has an error that is different from the 
other and has a different weight, the standard deviation of 
the error function can be expressed as the division of two 
terms namely the average error over time and the number of 
samples conditioned by the weight. The average standard 

25 deviation of the error function can be expressed as 
follows : 
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Equation 32 



ft-i 

7 = ii=S , 

A I 

i=0 ) 



where Wi is a weight value associated to a given error 
5 component. The square root of the number of samples 

conditioned by the weight , which corresponds to Vt of 
Equation 31, can be given by: 

Equation 33 



10 



Sample number 



ft-i \ 
Vi=o J 



Therefore the standard deviation computation can be reduced 
to the following expression: 

15 Equation 34 

i 

ft-\ 



2 



i=0 



In a least squares context, the weight w k of the error for 
each sample k is ZkZk. Therefore, in the current specific 
20 example, the standard deviation of the error function can 
be expressed as follows: 
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Equation 35 



1=0 



which can be reduced to the following: 



Equation 36 



1 



In statistics, it is well known that when an unbiased 
10 estimator of the variance (or standard deviation) of a set 
of sample is to be obtained/ the sample number is reduced 
by * v l" to obtain an unbiased effective sample set. The 
effective sample set can be expressed by: 

Equation 37 



15 



Effective Sample number • 



Vi=o 



ft-\ 
V*=o 



-1 



Therefore the standard deviation computation can be reduced 
as follows: 
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Equation 38 

^ (error, * wj 2 



1 



f t-i 



w. 



f t—\ 

2X 2 



-1 



Equation 39 

I 

^{error^wj] I £w/ 



(=0 



z=0 



Vi=o 



r-i A 

IX 

i=o y 



2 ft- 



V/=o 



10 



Equation 40 



E {error t * wj 2 
V*=o 

v T fv 
2>, - 2> 



In a least squares context, the weight w k of the error for 
each sample k is z k z k . Therefore, in this second specific 
15 example, the standard deviation of the error function can 
be expressed as follows: 
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Equation 41 




f t—\ 



J 



2 



5 For the purpose of a specific implementation, equation 41 
is used to characterize the standard deviation of the error 
function. 



As previously indicated, the above computations are 
based on the assumption that signals Z 102 and Y 106 are 
white and independent. The assumption that signal Z 102 
and signal Y 106 are independent is reasonable for many 

15 applications of adaptive filtering. It will be readily 
appreciated that when signal Z 102 and signal Y 106 are not 
exactly independent, the computations described in this 
specification may nevertheless be used with the knowledge 
that certain errors factors may be introduced by this 

20 approximation. 

However, the assumption that signals Z 102 and Y 106 
are white is not true in most applications. In order to 
solve this problem, signals Z 102 and Y 106 are divided 
25 spectrally into a set of frequency bands, where signal Z 
102 and Y 106 can be considered to generally be 
substantially white within a given frequency band. In the 
non-limiting example of implementation of an echo 
cancellor, the signals Z 102 and Y 106 (assuming a sampling 



Adjustments for the Assumptions 



10 
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rate of 8000 samples/sec and therefore a frequency spectrum 
from 0 - 4000Hz) are divided into 257 frequency bands of 
15.625 Hz each. Using heuristics measurements, this width 
has been found to be narrow enough that voice is 
5 approximately a white signal across each of the 15.625 Hz 
bands. The width of the bands may vary from one application 
to another without detracting from the spirit of the 
invention. The ^whiteness" of the signal is a subjective 
quality and depends on the nature of the signals being 
10 processed. The error function is then characterized for 
each frequency band independently using the above described 
computation to estimate the mean (which is 0) and the 
standard deviation. For each frequency band, the standard 
deviation of the error function can be computed as follows: 

15 Equation 42 



where z[j] and y[j] is the amplitude of the component of 
signal Z 102 and signal Y 106 respectively in frequency 
20 band j and o t [j] is the standard deviation of the error 
function in frequency band j at time t. 

Another assumption in the above computations is that 
the amplitude (or energy) of signal Y 106 is known. 
25 However, signal Y 106 is unknown since, if signal Y 106 
were known, the adaptive filter 170 would serve no 
practical purpose. The amplitude of signal Y 106 can be 
approximated by the amplitude of signal Y* 108. More 
specifically, in a least squares system, the forward signal 





|>,L/k[/] 
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Y 106 can be considered as made up of two (2) components, 
namely a first component Yc which is correlated with signal 
Z 102 and a second component Yu which is uncorrelated with 
signal Z 102. Because, by definition, Yc and Yu are 
5 uncorrelated, the energy of forward signal Y 106 is equal 
to the sum of the energies of Yc and Yu. Mathematically, 
this can be expressed as follows: 

Equation 43 

1 0 Yenergy = Yc energy + Yu energy 

The filter 110 in combination with adder 180 will 
generally eliminate most of signal Yc . Therefore, the 
energy of signal Y* 108 will be essentially equal to the 

15 energy of Yu which is less than or equal to the energy of 
signal Y 106. Therefore, since signal Y 106 is not 
available, the energy of signal Y* 108 is used as an 
approximation of the energy of signal Y 106. For each 
frequency band, the standard deviation of the error 

20 function using Y* 108 can be computed as follows: 

Equation 44 



*,[/]= 



V<=o 



Finally, although the above described standard 
25 deviation computations have been derived for an adaptive 
system having a single tap filter, similar derivations may 
be effected for a filter having N taps. In a practical 
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application, for a filter having N taps, the standard 
deviation computation becomes: 



Equation 45 

Xt^L/Wlj]) 2 



*,[/] = ■ 



/=0 



In view of the above description, deriving a standard 
deviation computation for N > 1 will be readily apparent to 
the person skilled in the art and as such will not be 
10 described further* 



Specific Implementation 



As depicted in figure 2, the performance evaluation 
15 unit 202 receives the first signal Z 102, the second signal 
X 104 and the new set of filter coefficients Hnew 206 from 
the coefficient generation unit 200. The performance 
evaluation unit 202 is operative to generate at least in 
part on the basis of the first signal Z 102 and the second 
20 signal X 104 a set of performance data elements Herror 208 
associated to the new set of filter coefficients Hnew 206. 
The performance evaluation unit 2 02 characterizes the error 
on a per-f requency band basis. Each performance data 
element in Herror 208 is a statistical estimate of the 
25 error function standard deviation for a respective 
frequency band. 
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Figure 8 shows a specific example of implementation of 
the performance evaluation unit 202 including a filter 
simulation unit 800, an adder unit 802, a first spectral 
5 calculator 806, a second spectral calculator 804 and a per- 
band standard deviation computation unit 808. 

The filter simulation unit 800 is suitably embodied as 
an adaptive digital filter and simulates the processing of 

10 filter 110 shown in figure 1. The filter simulation unit 
800 taps the return signal Z 102, and receives the new set 
of filter coefficients Hnew 206 from the coefficient 
generation unit 200. The filter simulation unit 800 
applies a filtering operation corresponding to the filter 

15 coefficients Hnew 2 06 to the return signal Z 102 to produce 
filtered signal R 801. The manner in which the filtering 
operative is applied was described with regard to filter 
110 in figure 1 and therefore will not be repeated here. 

20 The output of the filter simulation unit 800, namely 

the filtered signal R 801, is subtracted by adder unit 802 
on a sample -by- sample basis from the corrupted forward 
signal X 104 to yield a signal denoted W 870. Signal W 870 
is an estimate of signal Y 106 (figure 1) generated on the 

25 basis of the set of filter coefficients Hnew 206. 

First spectral calculator 806 taps first signal Z 102 
and divides the signal into a set of frequency bands. In 
a non-limiting example, the first spectral calculator 806 
30 processes a set of samples of signal Z 102 from which the 
set of filter coefficients Hnew 206 was generated, where 
the first sample of the set of samples was taken at time 
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t=l. The first spectral calculator 806 applies a set of 
Fast Fourier Transform (FFT) of length (K-l)*2, each Fast 
Fourier Transform (FFT) being applied to N of the samples 
of signal Z 102, where N is the number of taps of the 
5 adaptive filter 170, The computation of an FFT is well 
known in the art to which this invention pertains and as 
such will not be described further herein. For a given 
time t, the above calculation results into t/N sets of K 
spectral values of signal Z 102, each spectral value being 

10 associated to a respective frequency band from a set of K 
frequency bands. In a non-limiting example used in echo 
cancellation, K = 257 is used to divide the frequency 
spectrum of signal Z 102 into 257 frequency bands. If the 
frequency spectrum goes from 0Hz to 4000Hz (assuming a 

15 sampling rate of 8000Hz) , then there will be frequency 
bands centered at 0Hz, 15.625Hz, 15.625*2 Hz, 15.625*3 Hz, 
[. . .] and 4000Hz. Mathematically, this can be expressed 
as follows: 

Equation 46 

20 Z SPBCTRA =FFT(z(t)) = 

N 



'SPECTRA (0) 
Z SPECTRA 0) 
'SPECTRA (2) 



'SPECTRA 



' SPECTRA 



(K-2) 
(K-l) 



Z SPECTRA (0) 
Z SPECTRA (-0 
% SPECTRA (2) 



'SPECTRA 



'SPECTRA 



(K-2) 
(K-l) 



Z SPECTRA (0) 
% SPECTRA (0 
Z SPECTRA (?) 



'SPECTRA 



'SPECTRA 



(K-2) 
(K-l) 



where 



86147-5 



42 



SPECTRA (0) 
SPECTRA 0) 
SPECTRA 

SPECTRA 

where Z SPECTRA is a data structure of t/N vectors each of 
size K, each vector being indicative of a spectral 
representation of N samples of signal z(t) and Z S pectra (j) is 
5 the spectral value of signal Z 102 associated to frequency- 
band j . Zspectra 810 is released by the second spectral 
calculator 804. 



ZjjPECTRA 



Second spectral calculator 804 taps the signal W 870 

10 and divides the signal into a set of K frequency bands. 
In a non- limiting example, the second spectral calculator 
804 processes a set of samples of signal W 870 
corresponding to the set of samples of Z 102 processed by 
first spectral calculator 806, where the first sample of 

15 the set of samples of signal W 870 was taken at time t=l. 
The first spectral calculator 806 applies a set of Fast 
Fourier Transform (FFT) of length (K-l)*2, each Fast 
Fourier Transform (FFT) being applied to N of the samples 
of signal W 870 where N is the number of taps of the 

20 adaptive filter 170. The computation of an FFT is well 
known in the art to which this invention pertains and as 
such will not be described further herein. For a given 
time t, the above calculation results into t/N sets of K 
spectral values of signal W 870, each spectral value being 

25 associated to a respective frequency band from a set of K 
frequency bands. Mathematically, this can be expressed as 
follows : 
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Equation 47 



^SPECTRA W 
^ SPECTRA 0) 



SPECTRA 



(2) 



SPECTRA 

(K-2) 



W 



^SPECTRA (0) 
^SPECTRA 0) 

(2) 



SPECTRA 



SPECTRA 

(K-2) 



^SPECTRA ^) 



^SPECTHA (^) 
^ SPECTRA 0) 

(2) 



SPECTRA 



w, 



SPECTRA 

(K-2) 



^SPECTRA 1) . 



- — 1 



where 



j .SPECTRA 



SPECTRA 



SPECTRA 



w 



(0) 
(1) 
,(2) 



SPECTRA 



SPECTRA 



(K-2) 
(K-l) 



where W SPECTRA is a data structure of t/N vectors each of size 
K, each vector being indicative of a spectral 
representation of N samples signal W 870 and W SPE cTRA(j) is 
10 the spectral value of signal W 870 associated to frequency 
band j . W SPECTRA 812 is released by the second spectral 
calculator 804. 



Methods other than the FFT for dividing a signal into 
15 a set of frequency bands may be used by the spectral 
calculators 804, 806, such as for example a cosine 
transform and other similar transforms. Although first 
spectral calculator 806 and second spectral calculator 804 
are depicted as separate components in figure 8, it will be 
20 readily appreciated that they may be embodied in a same 
physical device and may share functional components without 
detracting from the spirit of the invention. 
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The per-band standard deviation computation unit 80 8 
receives Wspectra 812 and Zspectra 810 and processes each 
frequency band to generate an error characterization 
5 estimate Herror[j] for each band j, for j = 0 ... K-l. In a 
specific implementation, Herror[j] is the standard 
deviation of error function for frequency band j . The per- 
band standard deviation computation unit 808 also generates 
a per-band energy estimate for signal Z 102, identified as 
10 Zenergy 240 in figure 8. 

Figure 9 shows a conceptual block diagram of the per- 
band standard deviation computation unit 808. As depicted, 
the per-band standard deviation computation unit 808 

15 includes a set of K parallel computation units 900 where 
each unit 90 0 is operative to compute the standard 
deviation of the error function for a respective frequency 
band. If the frequency bands are narrow, the signals Z 102 
and W 8 70 can be considered "white" within a frequency band 

20 thereby allowing the following computation to be used: 



Equation 48 

for j=0...K-l. 



25 Hem>rlj] = 





iSPECTRA 




\ 



2 



5X 



i, SPECTRA 



i, SPECTRA 



i, SPECTRA 



V 



i=0 
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where Herrortj] is the performance data element for 
frequency band j and Herror 208 is a set of K performance 
data elements. Each unit 900 also releases a data element 
Zenergy [j] indicative of the energy of signal Z 102 in 
5 frequency band j and Zenergy 240 is a set of K energy data 
elements. Zenergy is computed as follows: 

Equation 49 

N . . 
ZenewUl = X \ Z USPECTRaU] X ^ SpECT ^[j]) for j = "1 

10 

The skilled person in the art will readily appreciate 
that the implementation depicted in figure 8 is for the 
purpose of example only as many other implementations are 
15 possible. 

Although the above described specific examples of 
implementations show the computations in the frequency 
domain of the auto-correlation of signal Z 102 and the 

20 cross-correlation of signals Z 102 and W 870, it is to be 
understood that the equivalent of either of these 
computations may be effected in the time domain without 
detracting from the spirit of the invention. For example, 
the auto-correlation and cross-correlation computations may 

25 be effected in the time domain and, subsequently, the auto- 
correlation divided spectrally in order to effect the 
computation of the standard deviation in the frequency 
domain. 

30 Figure 10 shows an alternative non- limiting 

implementation of the performance evaluation unit 2 02 
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including a ZZ and WW auto-correlation generator 950 and a 
per-band standard deviation computation unit 952. It can 
be noted that Herror can be expressed as follows: 



Equation 50 

For j=0...K-l 



H error [j]-- 



Z^i Wi>SPECTRA [J ] X ^i,SPECTRA [/] X .SPECTRA U ] X ^ i 



SPECTRA 



ft 



V ft 



^ ^USPECTRA [J ] X ^i,SPECTRA U~\ 



/=0 



10 Note that W hSPEcmA [j]xW hSPECTRA [j] is the i* 1 component of the 

auto-correlation of signal W 470 in frequency band j . Note 
that: 

Equation 51 

15 

.SPECTRA , SPECTRA , SPECTRA 

= ^i } SPECTRA Ul X X% t SPECTRA U1 ~ ^^i, SPECTRA U^i, SPECTRA I J] ® MO 
i, SPECTRA i. SPECTRA , SPECTRA i, SPECTRA 

[j]®h(t)®h(t) 

where ® denotes a convolution operation. As can be seen 
from the above equation, the auto -correlation of signal W 
20 870 can be obtained from the auto-correlation of signal X 
104, the auto-correlation of signal Z 102 and the cross- 
correlation of signal Z 102 with signal X 104. 
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The ZZ and WW auto-correlation generator 950 is 
operative to generate a sequence of W lSPECTRA [j]xW^ SPECTJt4 [j] auto- 
correlation data elements, shown as WW 956 in figure 10, on 
the basis of the relationship described in equation 3 8 
5 above and a sequence of Z lSPECTRA [j]xZ lSPECTEA [j] auto-correlation 

data elements, shown as ZZ 954 in figure 10. The ZZ and WW 
auto-correlation generator 950 may be implemented in a 
number of ways and the specific implementation is not a 
limiting element of the invention and will not be described 
10 in further detail herein as it will be readily apparent to 
the person skilled in the art. 

The per-band standard deviation computation unit 952 
receives a sequence of W^spectraU^^ijpectraU] auto -correlation 
15 data elements 956 and a sequence of Z lSPECTRA [j]xZ jSPECTRA [j] 954 

and computes Herror[j] for j=0.„K-l using the following 
relationship : 



20 



HerrorlJ}-- 



Eguation 52 

J] ^Wi, SPECTRA L/] X W lSpECTRA [j] X Z jSpECTRA [j] X Z iSp£CTRA [j]fj 



i=0 



— -1 

N 



^ ^ i, SPECTRA [7'] X ^ i, SPECTRA L/ 1 



i=0 



N 
i=0 



^! i^i, SPECTRA [J] X ^USPECTRA U]j 



The per-band standard deviation computation unit 952 
also releases a Zenergy 240 indicative of the per band 
25 energy of signal Z 102 computed as follows: 
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Equation 53 

U 

N i \ 

Z ener g yU]= Y,\ Z ^PECTmU^ USPECTRaUI) forj=Q..JC-l 

i=0 

Herror 208 and Zenergy 240 are released by the performance 
5 evaluation unit 202 and provided to the noise reduction 
unit 210 depicted in greater detail in figure 11. 

Noise Reduction Unit 210 

10 Figure 11 shows a specific example of implementation 

of the noise reduction unit 210 including an energy band 
comparator 1100, a correction signal generator 1102, an 
auto-correlation insertion unit 1104 and a filter 
coefficient computation unit 1106. 

15 

The energy band comparator 1100 determines for each 
frequency band in the set of K frequency bands whether the 
performance of the first set of filter coefficients Hnew 
206 is satisfactory or unsatisfactory for that frequency 

20 band. The energy band comparator receives Herror 208 
including a set of the amplitude values represented by the 
standard deviation values for the set of frequency bands. 
In a non-limiting example, for each frequency band j, for j 
= 0.-K-1, the energy band comparator 1100 performs the 

25 following comparison: 

Equation 54 

if Herror\j\ > Ethreshold[j] 

Performance[j] = unsatisfactory 
else Performance[j] ~ satisfactory 
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where Ethreshold [j ] is indicative of an amplitude threshold 
value for frequency band j and Perf ormance [ j ] is a 
performance indicator for frequency band j . The amplitude 
threshold may vary from one application to the other. In a 
5 non- limiting example of implementation, the threshold is 
selected based on the maximum amount of correlation that 
can be expected between the Z 102 and X 104 signals. If 
the error standard deviation value exceeds this amount then 
it can be deduced that the filter 110 may be added more 
10 correlation to signal X 104 than was initially present 
which is an undesirable behavior. 

In the specific example where the adaptive filter 170 
is used in an echo canceling system, a maximum value of 
15 0.5 (-6 dB) is used as the threshold value for all 
frequencies. The amplitude threshold value may be the same 
across all frequency bands such that Ethreshold [j ] 
Ethreshold for all j = 0...K-1 or may be a different value 
without detracting from the spirit of the invention. 

20 

The correction signal generator 1102 receives the 
performance indicators from the energy band comparator 
1100, the Herror 208 from the performance evaluation unit 
2 02 and the Z energy value 24 0 and generates a correction 

25 signal for each frequency band associated to a performance 
indicator indicative of an unsatisfactory performance. In 
a non-limiting example, the energy of the correction signal 
is a function of the standard deviation of the error 
function and of the energy of signal Z 102 within the same 

30 frequency band. A specific example uses the following 
mathematical computation to determine the energy of the 
correction signal: 



86147-5 



50 



Equation 55 

forj = 0...K-l 

if Performance[j] = unsatifactory 

(Herror\j] - E thresholdjj]) 
then Correction _signal[j] = Zenergy[j]X EthreshM[n 

else Correction _ signal[j] = 0 

5 where a correction signal for band j has an energy 
correction_signal [j] computed by the above equation and 
energy in frequency band j. The term correction_signal [ j ] , 
for j=0...K-l, in the above equation is indicative of a set 
of K correction signals, where each correction signal is 

10 associated to a respective frequency band. In a specific 
example of implementation, each correction signal is a 
signal of energy correction_signal [ j ] and having its energy 
substantially within the frequency band for which it was 
generated. For the purpose of simplicity, corrections 

15 signal including a single frequency, are generated by the 
correction signal generator, where the frequency is within 
the corresponding frequency band. 

In an alternative implementation, the functionality 
20 implemented by the energy band comparator 1100 and the 
correction signal generator 1102 may be combined into a 
single operation implemented by a single functional module. 
In this alternative implementation, the use of a 
Performance [j] data structure is omitted. The combined 
25 functionality may be described by the following: 
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Equation 56 



if Herror\j\ > Ethreshold\j] 



then Correction _ signal[j] = Zenergy[j] x 



{Herror\j\ - Ethreshold[j]) 
Ethreshold[j] 



else Correction _ signal[j] = 0 

The auto-correlation insertion unit 1104 receives the 
set of correction signals from the correction signal 
generator 1102 as well as the auto-correlation matrix from 
the auto-correlation memory unit 500 (shown in figure 5) , 
referred to as the initial auto-correlation matrix. The 
auto-correlation insertion unit 1104 is operative to modify 
the initial auto-correlation matrix on the basis of the set 
of correction signals received. 

In a non-limiting implementation, for each correction 
signal in the set of correction signals, an auto- 
correlation is performed over N samples of the correction 
signal in order to generate an NxN auto -correlation matrix. 
This generates a set of auto-correlation matrices, one 
matrix for each correction signal in the set of the 
correction signals. Following this, a matrix addition is 
performed between the set of correlation matrices 
associated to the set of correction signals and the initial 
auto-correlation matrix Ai obtained from the auto- 
correlation of signal Z 102. In the above fashion, a 
modified auto-correlation matrix A 2 1110 is generated. 
Matrix A 2/ as matrix A lf is symmetric and positive definite. 



The filter computation unit 1106- makes use of the 
modified correlation matrix A 2 1110 and the cross- 
correlation data elements from the cross -correlation memory 
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unit 501 (figure 5) and generates a second set of filter 
represented by a vector hg. 

The filter coefficient computation unit 1106 solves 
5 the following equation: 

Equation 57 

10 There are many known methods that can be used to solve 
linear systems of the type described by the above 
equations. Examples of such methods include direct matrix 
inversion, QR substitution, Cholesky decomposition, LU 
decomposition, Gauss- Jordan elimination, amongst others- 

15 Any suitable method for solving a set of linear equations 
may be used to derive vector h 2r where vector h 2 includes 
the second set of filter coefficients. For more 

information regarding methods for solving sets of linear 
equations, the reader is invited to refer to "Numerical 

20 Recipes in C: The Art of Scientific Computing", William H. 
Press et al . , Cambridge University Press (Chapter 2). The 
contents of this document are hereby incorporated by 
reference . 

25 The new set of filter coefficients is released as 

signal H 116 at the output 356 of the coefficient 
adaptation unit 100 for use by filter 110. 

It will be readily observed that when A 2 =Ai, H 116 is 
30 the same as Hnew 206, processing by the filter coefficient 
computation unit 1106 can be bypassed. 
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A typical interaction will better illustrate the 
functioning of the noise reduction unit 210. As shown in 
figure 12, at step 1202, for each frequency band in the set 
of K frequency bands, the error amplitude received in 
5 Herror 208 is compared to a threshold value for that 
frequency band. If the error amplitude for that frequency 
band exceeds the threshold value, at step 12 06, a 
correction signal within that frequency band is generated. 
Following step 1206, or alternatively if condition 1202 is 

10 answered in the negative, the system verifies at condition 
12 04 whether all the frequency bands have been processed. 
If there are remaining unprocessed frequency bands, the 
system returns to step 1202. If all frequency bands have 
been processed, at step 1208 a modified auto-correlation 

15 matrix A 2 is generated on the basis of auto-correlation 
matrix Ai and the set of correction signals generated at 
step 1206. At step 1210, a new set of filter coefficients 
H116 is computed on the basis of the modified auto- 
correlation matrix A 2 . 

20 

The above-described process for producing a set of 
filter coefficients can be implemented on a general purpose 
digital computer of the type depicted in figure 13, 
including a processing unit 13 02 and a memory 13 04 

25 connected by a communication bus. The memory includes data 
1308 and program instructions 1306. The processing unit 
1302 is adapted to process the data 13 0 8 and the program 
instructions 13 06 in order to implement the functional 
blocks described in the specification and depicted in the 

30 drawings. The digital computer 1300 may also comprise an 
I/O interface for receiving or sending data elements to 
external devices. For example, the I/O interface may be 
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used for receiving the first signal Z 102 and the second 
signal X 104. 

Alternatively, the above-described process for 
5 producing a set of filter coefficients can be implemented 
on a dedicated hardware platform where electrical/optical 
components implement the functional blocks described in the 
specification and depicted in the drawings. Specific 
implementations may be realized using ICs, ASICs, DSPs, 
10 FPGA or other suitable hardware platform. It will be 
readily appreciated that the hardware platform is not a 
limiting component of the invention. 

Although the present invention has been described in 
15 considerable detail with reference to certain preferred 
embodiments thereof, variations and refinements are 
possible without departing from the spirit of the 
invention. Therefore, the scope of the invention should be 
limited only by the appended claims and their equivalents. 

20 



